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ABSTRACT 


A specialization  of  the  dual  simplex  method  is  developed  for  solving 
the  linear  programming  (LP)  knapsack  problem  subject  to  generalized  upper 
bound  (GUB)  constraints.  The  LP/GUB  knapsack  problem  is  of  interest  both 
for  solving  more  general  LP  problems  by  the  dual  simplex  method,  and  for 
applying  surrogate  constraint  strategies  to  the  solution  of  0-1  "Multiple 
Choice"  Integer  programming  problems.  We  provide  computational  bounds  for 
our  method  of  0(n(log  n + log  m)),  where  n is  the  total  number  of  problem 
variables  and  m is  the  number  of  GUB  sets.  In  the  commonly  encountered 
situation  where  the  number  of  variables  in  each  GUB  set  is  the  same,  our 
bound  becomes  0(n  log  n) . These  bounds  reduce  the  previous  best  estimate 
of  the  order  of  complexity  of  the  LP/GUB  knapsack  problem  (due  to  Witzgall) 
and  provide  connections  to  computational  bounds  for  the  ordinary  knapsack 
problem. 
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1.  INTRODUCTION 


A good  deal  of  attention  has  been  given  to  standard  LP  knapsacks  for 
their  role  as  relaxations  In  branch  and  bound  methods  for  solving  Integer 
knapsack  problems  (2,  5,  9).  Such  problems  have  been  studied  as  an  end  In 
themselves,  and  also  as  surrogate  constraint  relaxations  for  more  general 
0-1  integer  programming  (IP)  problems. 

Many  0-1  IP  problems,  however,  are  of  the  "multiple  choice"  variety, 
attended  by  the  requirement  that  the  variables  of  partitioned  subsets  sum 
to  one.  Specialised  IP  methods  for  problems  involving  such  general lzod  upper 
bound  (CUB)  constraints  have  been  proposed  in  settings  of  varied  generality 
(e.g.,  (3,  A,  bl),  and  recently  some  attention  has  been  given  to  Integer 
knapsacks  with  CUB  constraints  |14,  IS).  To  solve  these  and  more  general 
problems  using  LP  and  surrogate  relaxations.  It  Is  important  to  be  able  to 
solve  LP/CUB  knapsacks  efficiently.  It  Is  also  valuable  to  be  able  to  solve 
LP/GUB  knapsack  problems  to  accelerate  the  solution  of  ordinary  LP/CUB  prob- 
lems by  the  dual  simplex  method,  as  pointed  out  by  Wltzgall  (lb).  Conse- 
quently, the  goal  of  this  paper  is  to  develop  an  algorithm  lor  the  LP/CUB 
knapsack  problem  that  is  both  easily  implemented  and  highly  efficient. 

Two  earlier  papers  dealing  with  this  problem  (In  slightly  less  general 
form  than  treated  here)  are  worthy  of  special  note.  The  paper  by  Sinha  and 
Zoltners  (15)  is  the  first  to  Identify  the  characteristics  of  the  undominated 
solution  space  for  the  case  in  which  the  knapsack  Is  an  inequality  constraint. 

These  authors  then  develop  a method  that  Is  reported  to  speed  the  branch  and 
bound  solution  of  the  integer  CUB  knapsack  problem.  The  second  paper,  due 
to  Wltzgall  (lb),  examines  the  case  where  the  knapsack  Is  an  equality  con- 
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stralnt  spanned  by  the  GUB  sets.  Wltzgall's  work  Is  especially  notable  for 
its  geometric  characterizat ions  and  the  specification  of  "worst  case"  compu- 
tational bounds  for  his  algor ithm.  In  particular,  the  algorithm  of  [16]  is 
shown  to  be  of  complexity  0(n  log  n)  + 0(m(n-m)),  where  n is  the  number 
of  variables  and  m is  the  number  of  GUB  sets.  This  is  the  first  result  that 
bounds  the  complexity  of  the  LP/GUB  knapsack  problem  in  this  manner. 

In  this  paper  we  use  a-’  alternative  framework  that  focuses  directly  on 
properties  of  the  dual  simplex  method  applied  to  the  LP/GUB  knapsack  problem. 
After  specifying  necessary  and  sufficient  conditions  for  dual  feasible  bases, 
we  identify  relationships  that  hold  automatically  in  the  application  of  the 
dual  simplex  method.  These  relationships  are  then  utilized  to  develop  a 
specialized  version  of  this  method  which  is  shown  to  be  of  complexity  at 
most  O(n(log  n + log  r.i) ) , or  in  the  case  where  each  GUB  set  contains  the 
same  number  of  elements,  0(n  log  n) . These  bounds  are  interesting  not  only 
because  they  reduce  the  previous  estimate  of  the  order  complexity  of  the  LP/ 
GUB  knapsack  problem,  but  also  because  they  reduce  to  the  same  form  as  one  of 
the  standard  algorithmic  bounds  for  the  ordinary  LP  knapsack  problem  without 
GUB  constraints,  thereby  establishing  a connection  between  these  more  and 
less  general  problems. 


2 . PROBLEM  NOTATION 

The  LP/GUB  knapsack  problem  may  be  written 


- cjxj 
jrN  1 J 


Minimize 


(1) 
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subject  to  ^ ax  - a 

J^N  J J ° 

^ x ■ 1;  k £ M “ {l,...,m} 

J?Jk  J 


where  J OJ 
p q 


x ^ - 0;  J c N - 

0 for  p i q and  J - U J C N. 

kcM 


(2) 

(3) 

(•i) 


There  are  no  restrictions  on  any  of  the  problem  coefficients  (a^,  a^ , 
Cj),  except  that  we  exclude  the  trivial  situation  in  which  a^  - 0 for  j f 
N - J. 


Two  subcases  of  Interest  included  by  our  results  are  for  N » J (as  in 
Witzgall  [16])  and  for  N - J * (nl,  where  is  a slack  or  surplus  variable 
(as  in  Sinha  and  Zoltner  [13]).  We  will  comment  on  the  specializations  of 
our  results  to  these  subcases  at  appropriate  points. 

To  begin,  we  make  a simple  and  well  known  observation  concerning  the 
structure  of  basic  solutions  for  this  problem. 


Remark  1.  In  every  basic  solution  to  the  equations  (2)  and  (3),  m - 1 of  the 
sets  J^,  k c M will  have  exactly  one  basic  variable.  The  remaining  set 
will  have  one  basic  variable  if  there  is  a basic  variable  in  N - J,  and  other- 
wise will  have  two  basic  variables.  (By  convention  we  refer  to  a variable  as 
"in"  a set  if  its  subscript  is  in  the  set.) 

To  facilitate  the  subsequent  development,  we  will  introduce  notational 
conventions  that  will  be  useful  for  depicting  the  form  of  a typical  basic 
solution  within  the  framework  of  the  dual  simplex  method.  Throughout  this 
paper,  we  will  let  J denote  the  exceptional  set  that  has  two  basic  variables. 
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when  this  situation  applies,  and  in  general,  let  x . denote  the  basic 

variable  (or  one  of  the  basic  variables)  in  set  J^,  k e M.  We  will 

suppose  that  k*  is  unique  for  each  set  J^,  and  call  the  starred 

basic  variable  for  J.  . In  the  case  of  J , we  will  denote  the  basic  vari- 
k q 

able  other  than  x . by  x As  will  be  seen,  this  convention  will  allow 
q*  q 

us  to  associate  different  formulas  with  x and  x , , though  of  course  these 

q*  q 

formulas  yield  equivalent  expressions  when  q*  and  q'  are  interchanged. 

Additionally  when  there  exists  a basic  variable  in  N-J  it  is  denoted  by 

x . Finally,  we  introduce  the  objective  function  variable  x » - S c x 
P ° jeN  J j 

whose  maximization  achieves  the  minimization  of  (1),  and  let  NB  denote  the 

index  set  of  current  nonbasic  variables.  (4) 

Basic  solution  forms 


Case  1.  x is  basic  in  N - J. 
P 

x + \ ux  = u 

° jeNB  J J ° 

X + ^ v X =*  v 

P jeNB  J J ° 


V + ^ X1  “ 

jeNBnjk  J 


1 k e M 


(Note,  NBflJk  - Jk  - {k*}.) 


Case  2.  No  variables  are  basic  in  N - J;  x , and  x . are  basic  in  J . 
q q*  q 

x + ^ ux  » u 

° jeNB  i J ° 

X , + ^ V X - V 

q jeNB  J j 0 

X . + V (1-V  )x  + “ (-V  ) X - 1 - V 

q jeNBOj^  J J JeNB-J^  J J 
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k e M - { q } 


For  our  subsequent  development,  we  need  to  identify  the  precise  con- 
nections between  the  coefficients  of  the  basis  representations  in  Case  1 
and  Case  2 and  the  coefficients  of  the  original  problem  representation  (1)- 


To  reduce  all  formulas  to  the  same  notation  for  both  Case  1 and  Case  2 


when  N i J , we  define  J = (N-J)U{n+l),  where  x , , is  a "fictitious" 

m+l  n+l 

variable,  unrestricted  in  sign,  with  a , , =*  c , , = 0,  We  further  specify 

° n+l  n+l 

that  x is  always  the  starred  basic  variable  for  the  set  J , ,,  i.e., 
n+l  m+i 

n+l  » (m+l)*.  Although  we  are  completely  unconcerned  about  the  value  of 

x , , , we  may  view  x , , as  def ini t tonally  equal  to  1 - 'V  x,  and  indeed 
n+1  n+1  j GN-J  j 

x^+j  will  receive  this  value  by  the  prescriptions  we  will  specify.  Upon 

defining  M = MUfm+l)  when  N t J and  M = M otherwise,  the  CUB  equations 
o o 

of  (3)  therefore  hold  with  M replaced  by  M^.  (That  is,  the  existence  of 
x^+^  would  make  Case  1 equivalent  to  Case  2 except  for  the  fact  that  x^+j 
is  unrestricted.)  In  particular,  then,  the  preceding  equations  for  the 
Case  2 basic  solution  may  be  regarded  as  also  applicable  to  Case  1,  for 
q = m + 1,  q’  * p and  q*  = n + 1,  enabling  subsequent  formulas  to  be  sim- 
plified. However,  we  will  on  occasion  find  it  useful  to  discuss  Case  l 
and  Case  2 on  separate  terms  (when  the  unrestricted  value  of  x has 
special  implications). 

By  these  conventions,  the  connections  between  the  current  basis  co- 
efficients and  the  original  problem  coefficients  are  expressed  in  the 
following  remark. 
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"m"‘  v 
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Remark  2.  Let  a “ a - ^ a,  . , 6 - a , 

° k£M  k*  1 


and  d 


J j j q 


v.(c  , ~ c .) 


Then  the  coefficients  of  (8)  - (11)  (with  M replaced  by  Mq)  may  be  expressed 
in  terms  of  those  of  (1)  - (4)  by: 

v ■ oi/6 
o 

v - (a  - a )/6  for  j e J. , k c M 
j j k*  k o 

Uj  “ dj  " Ck*  f°r  j £ Jk*  k C Mo 

The  derivation  of  the  remark  is  immediate  by  the  application  of 
Gaussian  elimination.  It  may  be  noted,  incidentally,  that  the  arbitrary 
designation  of  x^ , and  x^A  implies  that  the  coefficients  of  equation  (10) 
can  alternately  be  obtained  from  the  expression  for  the  v.  coefficients  in 
Remark  2 by  interchanging  q'  and  q*  in  this  expression. 


3.  PROPERTIES  OF  BASIC  DUAL  FEASIBLE  SOLUTIONS 

The  goal  of  this  section  is  to  identify  special  properties  of  basic 
dual  feasible  solutions  to  (1)  - (4),  as  a foundation  for  initialing  a dual 
method.  The  following  theorem  (which  slightly  generalizes  results  of  [15, 
16])  accomplishes  this  by  providing  necessary  and  sufficient  conditions  for 
a basis  to  be  dual  feasible — i.e.,  to  yield  u^  2 0,  j e NB,  in  the  expression 
for  x^  in  (5)  and  (8).  For  this  result  we  keep  Case  1 and  Case  2 separate. 


Theorem  1.  A basic  solution  is  dual  feasible  for  (1)  - (4)  if  and  only  if: 

k*  is  selected  si  that  d,  . » Minimum  {d,}  k e M - {w}, 

k*  . , j 

)EJk 


(where  d^  is  as  defined  in  Remark  2 and  in  Case  2,  {w}  « {q}  and 
{w}  - 0,  otherwise). 

Case  1.  c./a,  ^ c,/a,  h e H,  i e I 

h h i i 

where  H - {heN-J:  a^  < 0 } , I - {icN-  J:  >0}  and  p 1 s selected  to 

be  an  h e H that  yields  the  maximum  c^/a^  or  to  be  an  i e I that  yields  the 
minimum  c^/a^. 

Case  2.  q'  is  selected  so  that  c , v c.  for  all  1 c J such  that  a = a , 

q j q J q 


1 


(Cq i ~ cr ) / (a  t - ar),  r e R 


(c  , -c  )/(a  , -a),  seS 
q s q s 


h e H 


Ci/ai* 


i e I 


where  R ■ {r  e J : a <a'},S*{seJ:a  >a,). 

q r q q s q 

Then  q*  is  selected  to  be  an  r e R that  yields  the  maximum  value  of 

all  terms  on  the  left  of  the  foregoing  Inequality,  or  an  s e S that  yields 

the  minimum  of  all  terms  on  the  right  of  the  inequality,  provided  this  is 

possible  in  consideration  of  the  terms  c./a,  and  c./a  . (Otherwise,  the 

h h i i 

choice  of  q'  does  not  allow  dual  feasibility.  Also,  whenever  H or  1 is 
empty,  the  Inequalities  involving  the  corresponding  h e H or  i e I are 
not  applicable.) 


Proof . The  stipulations  about  k*  and  Case  1 are  immediate  from  Remark  2, 

noting  that  c^  * a^A  * 0 for  Case  1.  The  stipulations  about  Case  2 are 

derived  as  follows.  When  x , and  x . are  both  basic,  then  there  are  dual 

q'  q* 

multipliers  0 for  equation  (2)  and  n for  the  J equation  of  (3)  such  that 

q 


i 
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u,  ■ c,  - (Oa.  + it)  for  1 e .1  . These  multipliers  must  be  selected  to 

J J J q 

yield  u , * u 0.  From  u . * 0 we  obtain  n « c , - 0a  , , and  hence 
q q*  q q q 

Uj  ■ Cj  - c^,  + 0(a^,  “ aj)-  The  ^ua*  feasibility  requirement  u^  t 0 yields 

o,v  - .j) ; v - cj 

Thus,  if  a,  » a ,,  then  c , 2 c.,  as  first  stipulated  under  Case  2.  The  al- 

J q q j 

ternatives  a < a , and  a , N a , , identified  bv  I r R and  j e S,  respectively, 

j q J q 

yield 

(c  -c  ) / (a  ,-a  ) ^ 0 * (c  ,-c  )/(a  ,-a  ) r e R,  s e S 

' q j*  q ' I*  q ' JJ  q ' ^ 

Dual  feasibility  requirements  u^  • c - Oa^  2 0 for  j e N - J further  yield 


Ch/ah  - 9 : Ci/ai 


h c H,  i e 1 


leading  to  the  full  set  of  inequalities  stipulated  for  Case  2.  Finally,  the 
condition  u . « 0 requires  that  q*  be  selected  so  that  0 “ (c  . - c ^)/ 

q*  q q* 

(a  , - a . ) . This  completes  the  proof. 

q q 

Theorem  1 discloses  what  may  also  be  argued  by  simple  dominance  consider- 
ations— first,  that  we  may  throw  out  all  elements  of  a set  J with  tied  a 

* J 

values  except  for  one  with  the  smallest  c^  value,  and  second,  that  all  elements 

of  H and  l may  be  discarded  except  those  yielding  the  maximum  c^/a^  and  the 

minimum  c^/a  . Thus  N - J can  be  restricted  to  at  most  two  elements.  If 

both  these  elements  exist,  and  c./aL  > c,/a  , then  the  problem  has  an  un- 

h h t i 

bounded  optimum.  Otherwise,  Case  1 of  Theorem  1 provides  an  immediate  start- 
ing dual  feasible  basic  solution  whenever  N - J is  nonempty,  by  selecting 
either  x^  or  xt  as  a basic  variable  (according  to  which  of  these  variables 
exist).  This  observation  also  applies  when  N - J,  because  it  is  possible  to 


9 


add  an  artificial  variable  x (for  n increased  by  1),  yielding  N - J “ {n}, 
n 

with  a "1  and  c large.  (This  variable  is  not  to  be  confused  with  the 
n n 

"factitious"  x . . ) 

n+1 

However,  Theorem  1 also  makes  it  possible  to  obtain  starting  dual 

feasible  solutions  without  resorting  to  the  elementary  Case  1 situation. 

The  following  corollary  indicates  an  easy  way  to  do  this  when  N - J and 

N - J - {n}.  We  assume  for  this  setting  that  a^  “ 1 for  N - J ■ {n}.  In 

addition,  we  will  suppose  c “0  for  N - J ■ in},  using  Gaussian  elimination 

n 

on  the  objective  function  to  achieve  this  if  necessary. 

Corollary  1.  When  N ■ J or  N - J ■ {n},  a Case  2 starting  basic  dual  feasi- 
ble solution  can  be  obtained  by  designating  any  J to  be  J , selecting  q' 

k q 

so  that 


a , = Minimum  {a , } , 
4 jej  J 
q 


Minimum  {c , 1 
|eJ  : a =a 

q J q 


and  selecting  q*  £ S so  that 

(c  . - c , ) / (a  . - a , ) * Minimum  (c  - c ,)/(a  - a ,) 

q*  q q*  q S q s q 


If  S * 0,  then  x ,=  1 (and  the  problem  shrinks).  If  S ^ 0,  but 

q 

N - J = {n}  (with  a = 1 and  c =0),  then  c . < c , or  else,  again  x , ” 1. 

n n q*  q q 

(For  this  case  c,  ! c , for  j e J allows  x,  « 0.) 

j q q J 


When  N * J in  Corollary  1,  replacing  (2)  by  its  negative  leads  to  an 
alternative  application  of  the  corollary,  equivalent  to  picking  a^,  to  be  a 
maximum  and  selecting  q*  f R to  yield  a maximum  ratio. 

We  now  turn  to  the  main  results  of  this  paper,  characterizing  the  re- 
lationships of  the  dual  simplex  method  applied  to  (1)  - (4),  and  developing 


"Z^r  ■■  -.rr.-,  j — ■ rr ' 
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an  efficient  specialisation  for  this  problem.  As  a by-product  we  will  also 
Identify  ways  to  generate  other  starting  basic  solutions  that  accord  with 
the  conditions  of  Theorem  1. 


4 . SPECIALIZATION  OF  THE  DUAL.  SIMPLEX  METHOD 

For  convenience  in  the  following  development,  we  outline  the  steps  of 
the  dual  simplex  method  as  follows. 


Step  0.  Begin  with  a dual  feasible  basis. 

Step  1.  Select  any  equation,  other  than  the  xo  equation,  with  a negative 
constant  term.  (If  none  exists,  the  current  basic  solution  is  optimal.) 
Represent  this  equation  in  the  form  of  (9)  (thereby  identifying  the  out- 
going variable  as  x ,): 


Step  2.  Let  NB  - 
feasible  solution, 
to  yield 


x , + ]>  v x 

q JcNB  J 1 


(vo  < 0) 


{J  e NB:  Vj  < 0}.  I f NB  is  empty,  the  problem  has  no 
Otherwise,  select  the  Incoming  variable  x^ , 1 c NB 


u /v  - Maximum  {u  /v  } 
JeNB~  J J 


where  the  u,  coefficients  are  those  of  the  current  x equation  (8). 

J o 

Stop  3.  Execute  a basis  exchange  (pivot)  step  that  replaces  x^,  by  x{  in 
the  basis.  The  updated  form  of  the  pivot  equation  (9),  which  becomes  the 
new  x^  equation,  is 


x.  + ^ (v  /v  ) x , 

1 JcNB*  J 1 J 


V /v 
o 


1 


1 


i irwtmm 


wltetc  NH*  la  the  new  set  ot  nonbaalc  vm  IhI'U'h  (replacing  l by  q’)  and 
v^,  - l (as  implicit  in  ('I)).  The  updated  lorn  ot  nil  remaining  equations 
In  obtained  bv  lianas  lan  elimination  lor  equivalently,  direct  substitution) 
uatng  the  xt  equation  to  remove  x^  Irom  the  other  equatlune.  Then  return 
to  Step  l . 

The  foregoing  description  ot  the  dual  method  ia  entirely  genet  a l and 
not  apeettte  to  the  IJ'/UUU  knapsack  problem  except  lot  the  notation  linking 
the  current  pivot  equat  Ion  to  I'M  and  lit**  x^  equation  to  (St.  By  meaua  ot  thla 
notations!  llitk,  however,  we  mav  now  make  additional  obaervat  Iona  concerning 
the  aolution  path  ot  the  dual  simplex  method  tot  thla  problem. 

Note  tirat  ot  all  that  the  convention  ot  repreaent tug  the  pivot  equation 
itt  the  form  ot  la  entirely  permtaalble  in  the  restricted  netting  ot  the 

l.l'/UlIH  knapaack  problem  a luce  we  mav  alwava  interchange  the  rolea  ot  x^,  and 
x . aa  neceaaarv  to  allow  thla  representation.  I'learlv,  too,  at  mt'at  one  ot 

q" 

the  two  equat  tona  ('>1  and  llO)  can  have  a negative  conniaut  term  and  thereby 
quality  aa  the  pivot  equation.  Thun,  representing  the  pivot  equation  in  the 
torm  ot  (SI  aervea  to  ttniqttelv  identltv  the  indexes  q'  and  q*.  In  tact,  uatng 
the  connect  Iona  ot  Remark  , we  mav  immediately  expteaa  the  conditions  tot 
idem  t fv tug  v^  * 0 and  the  maximum  ratio  ot  Step  ot  the  dual  method  itt  terms 
ot  the  oiigtnal  problem  eoe t t Ic i ent a . 

Komai k I.  It  a , * a .,  then 

q »t* 

v ' l'  it  and  on  l v 1 1 a *■  a i l •’  l 

I I k* 

and  it  In  addition  v,  + 0,  v.  4 0 tot  | i l , It  t .1  (possibly  t - ul , then 

I h t u 


n./v,  2 u.  /v.  It  and  onlv  it  0 . 2 0, 

I I h h n * it 


wltete  0, 


- (cr  - c )/(*,  - a ),  II  a , ».  a , 
t g f a q q * 


theit  the  dl tectlon  ot  the  second 


Acs: 


inequality  in  (12)  and  in  (13)  is  reversed. 

Although  this  remark  follows  directly  by  substituting  the  coefficient 
identities  of  Remark  2 into  Remark  3,  its  implications  are  quite  useful. 

This  is  due  to  the  somewhat  surprising  fact  that  the  application  of  the  dual 
simplex  method  assures  that  if  a . > a . holds  at  one  iteration,  then  a . > 

q q*  q 

a . (for  other  indexes  q'  and  q*)  at  ail  iterations.  This  relationship  and 

q* 

others  associated  with  it  are  expressed  in  the  following  main  result  of  this 
section. 


Theorem  2.  Let  denote  the  set  containing  the  incoming  variable  x^  deter- 

mined in  Step  2 of  the  dual  simplex  method.  If  t * m + 1 (i.e.,  if  i e N-.J), 
then  the  pivot  must  yield  an  optimal  solution.  If  t i m,  and  if  the  pivot  does 
not  yield  an  optimal  solution,  then  upon  representing  the  next  pivot  equation 


also  as  (9),  all  of  the  following  hold: 


(a)  J becomes  the  new  J 

t q 


(b)  x . becomes  the  new  outgoing  variable  x , 

t K q 

(c)  x.  becomes  the  new  x . 

1 q* 

(d)  the  ratio  values  0..  *,  j e J.  , remain  unchanged  for  all  k e M - (t) 

j R"  x o 

(e)  a , > a . before  the  pivot  if  and  only  if  a . > a . (for  the  new 

q q*  q q* 

q'  and  q*)  after  the  pivot. 

(f)  Over  a series  of  pivots,  as  the  index  k is  periodically  selected  as  t, 
the  elements  a,  will  only  change  in  descending  sequence  if  a , > a . 

k*  q q* 

and  will  only  change  in  ascending  sequence  if  a . < a . 

q q* 

Proof . Each  of  the  assertions  is  a direct  outcome  of  applying  the  dual  simplex 


method.  First,  the  x^  equation  of  Step  3 of  the  dual  method  must  have  a posi- 
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tive  constant  term  (since  both  v and  v are  negative),  and  cannot  quality 


o i 

as  the  new  pivot  equation.  However,  this  equation  currently  lias  the  form 


of  (9)  (since  x and  not  x , is  the  current  starred  basic  variable  for  the 
t * 1 


set  Jj.)*  Thus,  equation  (10)  is  the  only  possibility  for  the  new  pivot 


equation,  in  which  case  it  may  be  put  in  the  form  of  (9)  by  interchanging  the 
roles  of  i and  t*.  The  interchange  of  i and  t*  is  unnecessary  if  l e N-J 


because  x „ is  the  unrestricted  variable  x and  an  optimal  solution  is  al- 
t*  n+1 


ready  obtained.  Otherwise,  if  the  current  solution  is  not  feasible  (the 


solution  value  of  x^  exceeds  1),  the  interchange  immediately  establishes 


(a),  (b)  and  (c)  of  the  theorem.  Next,  since  J is  the  only  set  in  which 


the  Identity  of  x^  changes  by  the  pivot,  it  also  follows  that  the  values 


0 change  only  for  k - t,  establishing  (d ) . The  condition  a , N a before 


jk*  •’  - - ■ • q-  q> 

the  pivot  is  equivalent  to  stipulating  a <•  a . in  consideration  of  the  fact 


that  v^  ^ 0 (Remark  3).  But  since  t*  becomes  the  new  q1  and  i becomes  the 


new  q*,  this  yields  (e).  Finally,  (f)  follows  directly  from  (e)  and  Remark 
3,  completing  the  proof. 


We  will  henceforth  suppose  for  simplicity  that  a , > a on  all  iterations. 


understanding  that  the  directions  of  Inequalities  specified  in  the  following 
discussion  may  have  to  be  reversed  if  this  is  not  the  case.  (Alternatively, 


it  is  always  possible  to  assure  a , s a ^ by  the  device  of  replacing  equation 


(2)  bv  its  negative  in  case  a , *■  a ..)  With  this  understanding.  Theorem  2 

q q* 


directly  implies 


Corollary  2.  (For  a , > a #) : If  the  maximum  ratio  R^,  given  by 


P 


— I I . 


• *•  - 


\ 
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Maximum  {0 

>CJk 

VV 


Jk* 


(14) 


is  known  for  each  set  J,  , k e M , together  with  the  index  i(k)  such  that 

k o 

- 0 ^ ^°r  ^ " i(k),  then  the  incoming  variable  x^  is  identified  by 

i “ i(t)  where  R » Maximum  { R,  } 

k e M k 

o 


(15) 


and  the  pivot  step  leaves  ail  R^  except  R{  unchanged  for  the  determination  of 

the  new  R by  (15)  at  the  next  pivot.  (If  a , < a .,  the  maximum  in  (14) 

t q q " 

is  replaced  by  a minimum  over  > a^*.) 

The  significance  of  Corollary  2 is  twofold.  First  of  all,  it  allows 
the  dual  simplex  method  to  be  implemented  for  the  1.P/GUB  knapsack  problem 
without  ever  explicitly  calculating  the  u^  and  v^  coefficients.  Secondly, 


it  allows  the  R^  values  to  be  efficiently  stored  in  a heap,  with  the 


maximum 


Rf  at  the  top.  Then  as  R^  is  removed,  and  replaced  with  a new  value,  the  un- 
changed values  of  the  remaining  R^  enable  the  heap  to  be  reconstituted  with 
minimal  computation  (on  the  order  of  0(log  m)). 

The  issue  remaining  before  giving  a detailed  specification  of  the  steps  of 
a specialized  dual  algorithm,  is  the  efficient  determination  of  R^  by  (14). 

Since  each  time  a new  R^  is  found,  the  variable  Xj^  will  become  the  new 
x^*  (the  next  time  k is  selected  as  t by  (15)),  all  of  the  .)  t such  that 
a)  “ al(k)  ma^  imrat‘diatf!ly  ke  dropped,  since  they  will  be  of  no  further  Interest , 
This  approach  by  itself,  as  will  be  shown,  leads  to  a specialized  method  whose 
worst  case  computational  bound  is  superior  to  that  of  (16)  when  the  number  of 
GUB  sets  exceeds  the  number  of  elements  in  each  set.  (This  generally  occurs 


r 
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in  practical  applications  of  an  "assignment"  nature,  where  the  number  of 
items  to  be  assigned  generally  far  exceeds  the  number  of  possible  assignments 
per  item.)  However,  an  even  better  approach  from  the  standpoint  of  worst 
case  bounds  results  by  a simple  preliminary  pass  through  each  set  J^, 
eliminating  in  advance  the  elements  that  do  not  qualify  to  be  selected  as 
k*.  Since  the  elements  that  are  left  will  be  visited  in  descending  order 
of  the  the  a,  values  (for  a , > a . ) , it  follows  that  each  sucessively  smaller 

j q q* 

Sj  will  be  the  next  a^*,  and  the  task  of  identifying  a maximum  by  (14)  is 
eliminated. 

Specifically,  then,  we  seek  to  identify  a subset  J°  of  whose  elements 

are  linked  by  a predecessor/successor  ordering,  where  the  immediate  successor 

s(J)  of  an  index  j e J°  identifies  the  next  element  that  qualifies  to  serve 

as  k*  after  j,  and  the  immediate  predecessor  p(j)  of  j identifies  the  element 

of  J°  that  qualifies  to  serve  as  k*  immediately  before  j.  Initially,  of 

course,  s(j)  and  p(j)  just  arrange  the  elements  of  in  descending  (ascending) 

order  and  we  will  suppose  that  in  the  process  of  creating  such  a linking  that 

duplicate  a^  values  are  removed  by  retaining  only  the  one  associated  with  the 

smallest  c value.  The  process  of  dropping  an  element  from  J in  the  construc- 
J k 

tion  of  can  be  accomplished  simply  by  linking  its  immediate  predecessor  to 
its  immediate  successor. 

Under  this  predecessor  /successor  linking,  (14)  can  be  written 
- ®jk*  ^or  successors  J of  i - i(k) 


Then  i will  become  the  new  k*  (excepi  lor  the  first  i selected  as  k*) . Thus, 
in  particular,  since  wc  may  eliminate  the  situation  of  tied  maximum  ratios  by 
selecting  the  one  with  the  smallest  a^  coefficient  (which  has  no  tied  successors). 
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and  since  dropping  superfluous  elements  will  yield  k*  » p(i),  the  identify- 
ing characteristic  of  becomes 

V1) > v1*  (16) 

for  all  successors  J of  i and  for  all  i e J^,  where  is  J°  stripped  of  its 
first  and  last  elements,  which  respectively  have  no  predecessors  or  successors. 
The  task  of  weeding  out  elements  of  to  assure  this  relationship  is  made  easy 
by  the  following. 


Remark  4.  The  inequality  (16)  holds  for  all  i e and  for  all  successors  j 

of  i if  and  only  if  it  holds  for  all  i e and  for  j = s(i). 


Proof . We  need  only  show  that  for  any  h,  i,  J,  r (taking  the  roles  h * p(i) , 
j * s(i)  and  r = s(j))  such  that  a^  > a^  > a^  ar»  the  two  "successive"  in- 
equalities 0 > 0..  and  0. . > 0 , imply  0 > 0 . First,  for  the  coefficients 

ih  jh  ji  rj  ih  rh 

as  ordered,  we  note  that  0..  > 0lt_  is  equivalent  to  0 > 0 , since  both  of 

ih  jh  jh  ji 

these  inequalities  reduce  to  c,  a , + ca  + c.a,  > c a + c a + c,  a . Similarly, 

hi  ij  Jh  ih  ji  h J 

0,.  > 0 . is  equivalent  to  0 > 0 . Hence  we  obtain  0..  > 0,,  > 0,,  > 0 , > 

Ji  rj  rj  ri  ih  jh  ji  rj 

0^  and  in  particular  0 > 0^ ^ , which  is  equivalent  to  0^  > 0^.  Consequently, 

0 > 0^,  completing  the  proof. 

To  make  convenient  use  of  this  observation  we  introduce  a dummy  index  0 

to  "start"  and  "terminate"  the  predecessor/successor  linking,  where  0 is  treated 

as  the  immediate  predecessor  of  the  largest  a^  and  the  Immediate  successor  of 

the  smallest  a . The  procedure  for  modifying  the  initial  linking  on  J so  that 
J K 

it  becomes  a linking  on  is  then  as  follows. 


0.  To  start,  let  h,  i and  J be  the  "first  three"  elements  of  J^»  that  is. 
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h ■ s(0),  i - s(h),  J * s(i).  (If  has  less  than  three  elements,  then 
and  nothing  is  to  be  done.) 

1.  Compare  0.,  to  0..  . 

ih  jh 

(a)  If  0^  > set  h » i and  go  to  Step  2. 

(b)  If  0^  3 0 or  if  0^  < and  p(h)  • 0,  drop  i and  go  to 
to  Step  2. 

(c)  If  0^  < 0 ^ and  p(h)  + 0,  drop  i,  set  i - h,  and  h - p ( i ) - 
Then  return  to  the  start  of  Step  1. 

2.  Set  i = j and  j “ s(i).  If  J “0,  the  procedure  stops  and  the 
linking  correctly  identifies  the  ordered  elements  of  J^.  Otherwise, 
return  to  Step  1. 

The  validity  of  the  foregoing  procedure  is  an  immediate  consequence  of 
Remark  4.  Note  that  the  index  j never  "backs  up"  to  a predecessor  value, 
but  remains  unchanged  in  Step  1 and  is  set  to  its  successor  at  Step  2.  Con- 
sequently Step  2 will  always  be  executed  n^  - 2 times,  where  n^  is  the  number 
of  elements  in  J^.  Whenever  the  method  does  not  go  to  Step  2,  the  index  i is 
dropped  at  1(c),  which  can  occur  at  most  n^  - 2 times  (since  i is  never  the 
first  or  last  element),  for  a total  number  of  iterations  of  the  procedure 
equalling  at  most  2(n^  - 2).  This  procedure  is  patterned  after  one  due  to 
Wltzgall  [16]  (who  obtains  a different  iteration  count)  except  that  Witzgall's 
approach  is  based  upon  a geometric  determination  of  the  locations  of  points 
on  or  below  line  segments,  rather  than  on  a direct  comparison  of  ratios  as 
afforded  by  Remark  4. 

It  should  also  be  noted,  in  contrast  to  the  less  general  situation  ex- 
amined in  [lbj,  that  the  elements  of  may  not  all  qualify  to  be  basic  in  a 
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dual  feasible  solution.  If  N i .1,  it  is  additionally  necessary  that  the 
ratios  0^  ^ be  bounded  by  the  limiting  ratios  from  N - J,  as  shown  in 
Theorem  1.  This  means  that  some  of  the  Initial  and  final  elements  of 

k 

(under  the  predecessor/successor  linking)  may  also  drop  out  of  consideration. 
Rather  than  bothering  to  check  for  this  situation  in  advance,  however,  the 
first  and  last  relevant  elements  of  .1^  can  be  determined  automatically  by 
starting  from  some  Initial  basic  dual  feasible  solution  and  simply  executing 
the  specialized  dual  algorithm. 

In  general,  these  observations  lead  to  the  following  Corollary  as  an 
extension  of  the  options  available  from  Corollary  1 for  obtaining  an  initial 
dual  feasible  basis. 


! 


Corollary  3.  The  set  of  Case  2 dual  feasible  bases,  any  one  of  which  provides 

an  acceptable  starting  basis  for  the  specialized  dual  simplex  method,  can  be 

generated  by  selecting  an  arbitrary  to  be  J°,  and  selecting  any  element  i 

K q 

from  this  set  (other  than  the  first  element)  such  that  O,  ...  satisfies  the 

ip  ( i ) 

limiting  bounds  from  N - J (identified  in  Theorem  1).  Then  i and  p(i)  may 
respectively  serve  as  q'  and  q*.  If  no  such  element  i exists,  then  some  other 
set  must  serve  as  , and  whatever  element  of  the  "unacceptable"  thereby 
enters  the  basis  in  the  starting  solution  is  compelled  to  be  basic  in  all  dual 
feasible  bases  (hence,  the  associated  variable  may  be  fixed  at  the  value  1). 

The  elements  q'  and  q*  found  in  Corollary  3 may  need  to  be  interchanged, 
so  that  the  first  pivot  equation  can  be  represented  by  (9).  (In  this  case, 

. 

the  a^,  > a^A  assumption  must  be  replaced  by  the  a^A  > a^,  assumption,  re- 
versing the  roles  of  the  predecessor/successor  links.)  If  a Case  1 basis  is 

used  as  the  start,  then  a s 0 (for  x the  basic  variable  in  (5))  implies 

P P 


A 


A 


k - .i~.  - - - k . 
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a , > a . on  all  iterations  (since  p takes  the  initial  role  of  q'  with 

q q* 


. ■ a . . *0),  whereas  an  artificial  start  (with  p ■ n,  a - 1 and  c 
I*  n+1  r n n 


large)  will  select  the  first  ("largest  a^")  element  of  each  as  the 


initial  a,  . . 

k* 


The  specialized  dual  simplex  method  based  on  the  foregoing  results  may 
now  be  described  as  follows. 


The  Specialized  Dual  Simplex  Method 


1.  Initialization. 


(a)  Create  the  predecessor/successor  linkings  and  the  sets,  k f M^. 


(For  N i J,  define  J to  be  the  set  containing  the  elements  (at 

m+l 


most  two  in  number)  with  limiting  ratios  identified  by  Theorem  1.) 
(This  step  can  be  deferred  or  applied  in  conjunction  with  Step  1(b), 
using  the  starting  basis  there  to  reduce  the  range  of  elements 


considered  for  Inclusion  in  the  J,  sets.) 

k 


(b)  Create  a starting  dual  feasible  basis  (as  by  Theorem  1 and  Corollary  1 


or  Corollary  3).  Compute  the  Initial  value  by  computing 


a - a - J.  a,  . and  v - a/ (a  , - a . ) 
O kcM  k»  o q q* 


If  v * 0 and  either  q'  CN-Jorv  i 1,  then  the  current  basic 


solution  (x,*v,x.»l-v  and  x,  * l.k  e M - {q})  is  op- 
q o q*  o k*  ’ o 1 


q-  o q> 

timal.  Otherwise,  interchange  q'  and  q*  if  necessary  so  that  v < 


0.  For  what  follows  we  suppose  a , > a . (If  not,  the  word 

q q* 


"maximum"  should  be  replaced  by  "minimum,"  and  the  successor  » ^hol 


n 


s()  should  be  replaced  by  the  predecessor  symbol  p().) 
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(c)  Identify  the  ratios  R^  ■ G>s(k*)lc*  for  each  k e Mq.  (If  s(k*)  ■ 0, 

the  ratio  R^  does  not  exist,  and  is  bypassed.  For  the  case  k ■ m + 1 

where  by  convention  k*  * n + 1,  we  define  s(k*)  to  be  the  first 

element  of  J°.,  excluding  the  current  q'  (if  q'  e J , ) . Hence 
m+1  nrri 

R ■ c /a  for  j - s(k*),  if  this  element  J exists.)  Put  these 
m+1  j j 

ratios  in  a heap,  with  the  maximum  at  the  top. 

2.  Identify  the  incoming  basic  variable  and  the  new  basis  composition. 

Pick  the  maximum  ratio  from  the  top  of  the  heap  and  denote  it  R{ . (If 

the  heap  is  empty,  there  is  no  feasible  solution.)  The  current  variable 

x , leaves  the  basis  and  x . . . enters  the  basis.  If  s(t*)  e N - J,  the 
q'  s(t*) 

current  basic  solution  is  optimal  for  q'  - s(t*)  and  v^  * a/(-a^,)  (where 

a is  unchanged  from  its  previous  value).  Otherwise,  the  current  x . 

t * 

becomes  the  new  x^, , while  *s  the  new  Xq**  i»e.  , set  q'  - t*  and 

q*  ■ t*  - s(t*) . 


3.  Update  the  current  basic  solution. 


Update  a and  v by  setting  6 - a , - a , a - a + 6 and  v - a/6.  If 
r o q q*  o 

v^  I 0,  the  current  basic  solution  is  optimal.  Otherwise,  identify  the 

new  value  of  R • 0 . ..  . (for  the  new  t*).  If  the  ratio  does  not  exist 

t s (t  *) t * 

(s(t*)  - 0),  reform  the  heap  for  the  ratios  still  in  it.  Otherwise,  add 


R^  back  to  the  heap.  Then  return  to  Step  2. 


An  analysis  of  the  maximum  amount  of  computation  required  by  this  method 
is  an  follows.  The  creation  of  the  predecessor/successor  linkings  (that  ini- 
tially arrange  the  a coefficients  in  descend lng/ascending  order  for  each  J ) 

J K 

requires  on  the  order  of  0(n^  log  n^)  computation  for  each  set,  or  an  effort 
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of  at  most  E 0(n,  log  n ) * 0(n  log  n) . (For  the  case  where  each  GUB 
keMo  k k 

set  has  the  same  number  of  elements,  n/m,  we  may  refine  this  to  0(n(log  n - 
log  m)) .) 

o 

The  work  to  modify  the  linking  to  identify  the  set  involves  at  most 
2n^  - 4 iterations  of  the  procedure  based  on  Remark  4,  or  2n  - 4m  iterations 
over  all  sets,  requiring  computation  or  order  0(n  - m)  5 0(n).  Creating  the 
starting  feasible  basis  requires  an  effort  of  at  most  0(n)  (including  the  ef- 
fort of  generating  and  selecting  the  minimum  d^  values)  while  computing  the 
Initial  v^  value  is  0(m).  Finally,  computing  the  ratios  requires  0(ra) 
computation,  while  putting  them  in  a heap  is  an  effort  of  order  0(m  log  m) . 
Thus,  the  total  initialization  effort  of  Step  1 can  be  expressed  as  0(n  log  n) 
+ 0(m  log  m) . 

For  Steps  2 and  3,  at  most  n - m - 1 elements  (the  successors  of  the  k* 
elements,  excluding  the  initial  q')  remain  to  be  examined  in  the  sets, 

k C and  so  these  steps  will  require  at  most  n - m - 1 iterations.  Exclu- 
sive of  reforming  the  heap,  these  two  steps  require  a handful  of  "if  checks," 
assignments,  a couple  of  additions  and  1 division.  Reforming  the  heap  re- 
quires an  effort  of  O(log  m) , hence  in  total  the  amount  of  effort  required  at 
Steps  2 and  3 is  0((n  - m) log  m) . Putting  these  together  with  the  effort 
required  at  initialization  we  can  state 

Theorem  3.  The  computational  complexity  of  the  LP/GUB  knapsack  problem  is  of 


order  at  most 


0(n  log  n)  + 0(n  log  m) 


O(n(log  n + log  m)) 
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We  have  stated  these  order  bounds  separately  Instead  of  simply  giving 
the  O(n(log  n + log  m) ) bound,  because  of  the  overestimate  involved  in  the 
0(n  log  n)  terra.  In  particular,  as  previously  noted,  this  term  can  instead 
be  expressed  as  O(n(log  n - log  m))  for  the  situation  in  which  each  CUB 
set  has  n/m  elements.  Thus,  in  this  case  we  have 

Corollary  4.  When  each  CUB  set  contains  the  same  number  of  elements,  the 
computational  complexity  of  the  LP/GUB  knapsack  problem  is  at  most  0(n  log  n) . 

The  bound  of  Wltzgall  is  given  in  (16]  as  0(n  log  n)  + 0((n  - m)m) , 
where  the  0(n  log  n)  term  is  essentially  the  same  as  that  of  Theorem  3,  and 
also  can  be  replaced  by  0(n(log  n - log  m))  for  GUB  sets  with  n/m  elements. 

The  primary  difference  between  the  bound  of  [16]  and  that  of  Theorem  3 is 
therefore  the  contrast  between  0((n  - m)m)  and  0(n  log  m) . For  easier  com- 
parison, let  g - n/m  (so  that  g is  the  number  of  elements  in  each  GUB  set  if 
each  set  has  the  same  cardinality).  Then  these  terms  can  be  respectively 
written  0((g  - l)m‘)  and  0(g(m  log  m)).  Since  g 2 2 in  any  meaningful 
problem  (or  else  there  are  GUB  sets  with  only  1 element),  the  latter  term 
clearly  represents  a smaller  order  of  effort  than  the  former,  particularly  as 
m or  g (hence  n)  becomes  larger.  This  difference  appears  to  stem  from  the 
fact  that  our  procedure  specializes  the  dual  simplex  method  directly,  whereas 
Witzgall's  instead  carries  out  preliminary  "topological  reductions"  (corres- 
ponding to  those  obtained  via  Remark  4)  but  otherwise  leaves  the  dual  method 
primarily  to  its  own  devices  (for  the  case  J “ N) . (Sinha  and  Zoltner's  pro- 
cedure and  Witzgall's  procedure  appear  closely  related  in  this  respect.) 

It  is  interesting  to  note  the  type  of  order  bound  that  results  for  our 
method  when  the  initialization  effort  of  setting  up  the  predecesor/successor 
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links  and  adapting  them  to  the  sets  is  not  employed. 
The  modifications  for  this  approach  are  as  follows. 


Alternative  method.  (Omitting  the  initial  ordering  of  the  a^  coefficients  by 
the  predecessor/successor  links,  and  the  creation  of  the  J°  sets.) 


1.  Initialization. 


(a)  Deleted 

(b)  As  in  the  previous  method,  except  that  Corollary  3 is  not  used  as 

a strategy  for  creating  an  initial  basis.  In  addition,  drop  the 

index  k*  from  each  J,  . 

k 

(c)  Instead  of  setting  » ®s(k*)k*’  examine  each  j e (for  as 

currently  constituted).  If  a ^ a then  drop  j from  J , and  if 

J K K 

not  compute  the  ratio  0 . , saving  the  minimum  of  these  computed 

jk* 

ratios  as  R^.  (Then  s(k*)  denotes  the  j that  gives  this  minimum 
ratio. ) 


2.  Identify  the  incoming  basis  variable  and  the  new  basis  composition. 

As  in  the  previous  method. 

3 . Update  the  current  basic  solution. 

As  in  the  previous  method,  except  for  setting  R = 0 . ..  ..  Instead, 

t s ( t *)  t * 

first  drop  t*  from  , and  for  each  remaining  j e (as  currently  con- 
stituted) carry  out  the  operation  indicated  in  1(c)  for  k - t. 
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The  type  of  analyses  applied  to  the  computations  for  the  previous 
method  allows  us  to  state 

Corollary  5.  When  each  GUB  set  has  the  same  number  of  elements  g - m/n, 
the  computational  effort  required  by  the  Alternative  Method  for  the  LP/GUB 
knapsack  problem  is  of  order 

0(n)  + 0((n  - m)log  m)  + 0((n  - m)g) 
or 

0(n)  + 0((n  - m) (g  + log  m) 

Again  we  have  written  the  bound  in  different  ways  to  facilitate  comparison 
with  the  other  bounds.  The  0(n)  term  here  is  comparable  to  a 0(n)  term  that 
was  previously  assimilated  into  0(n  log  n)  in  both  our  approach  and  in  Witz- 
gall's.  Thus,  for  a clearer  comparison,  the  bound  of  Corollary  4 can  be  re- 
written 

0(n)  + 0(n  log  n) 

and  that  of  Witzgall  can  be  written 

0(n)  + 0(n  log  g)  + 0((n  - m)m) . 

While  the  worst  case  bound  of  Corollary  4 appears  generally  superior  to  the 
other  two,  note  that  the  bound  for  the  Alternative  Method  appears  more  attrac- 
tive than  that  of  [16]  for  g - m,  and  becomes  increasingly  attractive  as  m 
becomes  larger  relative  to  g,  due  to  the  fact  that  increases  in  log  m are 
dwarfed  by  increases  in  m.  (The  value  of  m is  often  several  fold  greater 
than  g in  practical  applications.  For  example,  in  the  applications  of  [8, 

11,  12,  13],  m ranges  from  4g  to  50g.)  Coupling  this  with  the  fact  that  the 
Alternative  Method  requires  less  "set  up"  effort  than  the  other  methods  makes 
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it  an  appealing  alternative  for  problems  in  which  worst  case  bounds  are  ex- 
pected to  be  overly  pessimistic.  In  this  context,  any  attempt  to  consider 
"likely"  cases  instead  of  worst  cases  must  also  account  for  the  advantages 
that  may  derive  from  initiating  a specialized  dual  algorithm  from  an  ad- 
vanced starting  basis,  rather  from  an  "extreme  end"  of  the  dual  feasible 
region  (as  in  [15]  and  [16]). 

Finally,  it  is  interesting  to  consider  the  specialization  of  these  bounds 
to  the  ordinary  knapsack  problem.  In  this  problem,  the  number  of  variables 
before  adding  slacks  to  give  GUB  constraints  is  m “ n/2  (i.e.,  the  addition 
of  slacks  yields  g - 2).  Bounds  of  both  previously  indicated  versions  of 
the  Specialized  Dual  Simplex  Method  (from  Corollary  4 and  Corollary  5)  re- 
duce to  0(m  log  m)  in  this  case,  which  is  a standard  bound  for  algorithms  for 
the  knapsack  problem.  Recently,  however,  Balas  and  Zemel  [1]  have  developed 
an  improved  bound  of  0(m)  for  m variable  knapsacks.  This  raises  the  interest- 
ing question  of  whether  it  is  possible  to  find  a method  for  the  general  LP/ 

GUB  knapsack  problem  whose  worst  cane  computational  effort  specializes  to 
0(m) , yet  that  maintains  advantages  for  the  general  case.  We  conjecture  that 
this  is  not  possible. 
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